COMPUTING THE RANK AND A SMALL NULLSPACE BASIS 
OF A POLYNOMIAL MATRIX 

Arne Storjohann*and Gilles Villard^ 

o 

>>: 

l£3 ' Abstract 

We reduce the problem of computing the rank and a nullspace basis of a univariate 
polynomial matrix to polynomial matrix multiplication. For an input n x n matrix of 
degree d over a field K we give a rank and nullspace algorithm using about the same 
number of operations as for multiplying two matrices of dimension n and degree d. If the 
' latter multiplication is done in MM(n,d) = 0~(n UJ d) operations, with u the exponent of 

{/y , matrix multiplication over K, then the algorithm uses 0"(MM(n, d)) operations in K. For 

m x n matrices of rank r and degree d, the cost expression is 0~(nmr w ~ 2 d). The soft-0 
, notation 0~ indicates some missing logarithmic factors. The method is randomized with 

Las Vegas certification. We achieve our results in part through a combination of matrix 
Hcnscl high-order lifting and matrix minimal fraction reconstruction, and through the 
' computation of minimal or small degree vectors in the nullspace seen as a K[x]-module. 

O ' 
CO 

■ 1 Introduction 

O ' 

Two n x n univariate polynomial matrices over a field K, whose entries have degree d at most, 
can be multiplied in MM(n,d) = 0~(n tJ d) operations in K E] where uj is the exponent of 
matrix multiplication over K 8, Chapter 15]. For M £ K[x] nxn of degree d we propose an 
algorithm that uses about the same number of operations for computing the rank r of M, and 
n — r linearly independent vectors N\ in K[x] n such that N{M = 0, 1 < i < n — r. The cost of 
the algorithm is 0~(MM(re, d)) = 0~(n ul d) operations in K. If M is m x n of rank r, a more 
precise and rank-sensitive expression of the cost is 0~{nmr w ~' 2 d) (see Theorem 17.4(1 . The 
soft-0 notation 0~ indicates missing logarithmic factors a(log n)^(log d) 7 for three positive 
real constants a, (3, 7. We mention previous works on the subject in Section [2j Our main 
idea is to combine matrix lifting techniques |311 132j . minimal bases computation and matrix 
fraction reconstruction pfl I15( I16j , together with a degree / dimension compromise for keeping 
the cost of the computation as low as possible. Within the target complexity, lifting used 
alone only allows to obtain few vectors of large degrees, while minimal bases used alone only 
leads to an incomplete set of vectors of small degrees. 

Our study extends the knowledge of the interaction between matrix multiplication and 
other basic linear algebra problems on matrices over K[x]. Indeed, the interaction is quite 
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well known for linear algebra over a field. For instance we refer to the survey [SJ Chapter 16] 
for a list of problems on matrices in K nxn that can be solved in 0(n u ) or 0~(n UJ ) operations 
in K. Only recent results give an analogous view (although incomplete) of the situation for 
polynomial matrices. It is known that the following problems can be solved with 0~(MM(ra, d)) 
operations: linear system solution, determinant, order d approximants, Smith normal form, 
and, for a non-singular matrix, column reduction jl 51 1311 132] . It is possible to compute the 
inverse of a generic matrix in essentially optimal time 0~(n 3 d) ^Hj. We may also consider 
the problem of computing the Frobenius normal form, thus in particular the characteristic 
polynomial, of a square matrix. It does not seem to be known how to calculate the form in 
time 0"(MM(n,d)). The best known estimate 0~(n 2 d) is given in j^J (see also |18j ) with 
u = 2.376 dU. 

Hence, we augment the above list of problems solved in 0~(MM(n, d)) with the certi- 
fied computation of the rank and a nullspace basis. This improvement is made possible by 
combining in a new way the key ideas of |15( I16[ I31j . For the rank, the target complexity 
0~(MM(n, d)) was only attainable by a Monte Carlo (non-certified) approach consisting in 
computing the rank of M(xq) for xo a random value in K (see Lemma l7.3|) . In obtaining a 
certified value of the rank and a nullspace basis within the target complexity, a difficulty is 
related to the output size. For M G K[x] 2nxn of degree d and rank n, Gaussian elimination 
(fraction free or using evaluation / interpolation) leads to a basis of n vectors of degrees nd in 
K[x] 2n in the worst-case, hence to an output size in @(n s d). A complexity in 0~{n^d) must 
therefore rely on a different strategy. 

We propose a sort of elimination scheme based on minimal polynomial bases. A minimal 
basis of the nullspace as K[x]-module is a basis with lowest possible degrees (all necessary 
definitions are given in Section |2J). For M G K[x] 2nxn as above, the total size of a minimal 
basis of the nullspace is in 0(n 2 d) (see Theorem 13.3(1 . However, it is not known how to 
reduce the problem of computing such a basis to that of polynomial matrix multiplication. 
In the same context, minimal bases have been already used for computing the inverse of a 
polynomial matrix in [T^], but only the generic case has been solved. Indeed, for a generic 
M € K[x] 2nxn , the degrees in a minimal basis of the nullspace are all equal to the input degree 
d, and somehow, a basis is easy to compute in 0~(MM(n, d)) operations ^3 Section 4]. In the 
general case, the vector degrees in a minimal basis may be unbalanced, they range between 
to nd. Known methods whose cost is essentially driven by the highest degree do not seem to 
allow our objective. 

Our solution presented in Section [7] is to slightly relax the problem, and to compute a 
small degree — rather than minimal — nullspace basis in a logarithmic number of steps. We 
rely on the fact that even in the unbalanced degree case, the sum of the degrees remains 
bounded by nd ( Theorem 13.3(1 . Intuitively, at step A; for 1 < k < log 2 n, we compute about 
n/2 k vectors of degrees less than 2 k d. Algorithm Nullspace(Af ) in Section (whole nullspace) 
calls at most log 2 n times Algorithm Nullspace minimal vectors(Af, 5) of Section (nullspace 
vectors of bounded degree 5) with increasing degree thresholds 8. To keep the cost as low 
as possible, the degree increase requires to reduce the dimensions of involved matrices in the 
same proportion. We refer to an analogous degree / dimension compromise in W2\ Section 17] 
for computing the Smith normal form, and in |161 Section 2] for inversion. 

For a general view of the process, including successive compressions of the problem into 
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smaller problems for reducing dimensions, consider 

€ K[x] mxn (1) 

with A square and non-singular. The rows of the matrix — I m — n ] give a basis of the 

nullspace of M. However, as noticed previously a direct calculation of BA~ X would be too ex- 
pensive. Now, note that if [BA" 1 — J m _ n ] = S~ 1 N, for S and N two appropriate polynomial 
matrices, then the rows of S[BA~ l —I m _ n ] = N are also in the nullspace. A key observation, 
see Section |1J is that considering a polynomial matrix N instead of [i?^4 _1 — I m - n ] takes 
advantage of minimal bases properties and allows us to manipulate smaller degrees. 

In algorithm Nullspace we proceed the following way. We deal with a small number of 
submatrices of the initial input for reducing the problem to 

€ K[x] (n+p)xn , 1 <p<n, (2) 

and introduce appropriate "compressing" matrices P € K[:c] ,ixp (successive choices of p are 
guided by the compromise with the degree) . We start with a matrix lifting / fraction re- 
construction phase. We compute an expansion of H = BA^ 1 in K[[x]] pxn using [311 I32| to 
sufficiently high order, and "compress" it to H p = BA~ l P € K[[x]] pxp . A reconstruction 
phase ^ E] (see also the comments about coprime factorization in Section EJ) then gives 

S- l N p = BA- l P. (3) 

We prove that "good" choices of P imply that S — denominator matrix for BA~ l P — is also a 
denominator matrix for BA~ l (Proposition I4.2j) and that vectors in the nullspace of M can 
be recovered (Proposition Indeed, the computation of S[H — I m - n ] mod x s+1 gives row 
vectors in the nullspace of degrees bounded by 5 ( Proposition Id4j) . For a candidate Monte 
Carlo value ro for the rank, in log 2 n steps of compression / uncompression (and choices of 5 
and p) combined with matrix lifting / matrix fraction reconstruction, we are able to compute 
candidate vectors for a nullspace basis. A final multiplication certifies that the rank is correct 
(i.e., ro = r) and that a nullspace has actually been computed. 

Although for each degree threshold 5 we compute a minimal polynomial basis, the com- 
pression strategy unfortunately does not lead to a minimal polynomial basis for the whole 
nullspace. However, we prove especially in Proposition 17. II that vectors with reasonably small 
degrees are obtained. 

Our algorithms are randomized of Las Vegas kind — always correct, probably fast. Ran- 
domization is essentially linked to the compression stages where the matrices P are chosen 
at random of degree d in K[x] nxp . We also use random matrices Q over K for linear indepen- 
dence preconditioning ^U], or random evaluation points xo in K. Our results are proven for 
symbolic points a^o and matrices P and Q. By evaluation [121 ESI ES1 , the same results hold 
with high probability for random xq, P and Q if K has enough elements, see Remark l7.6l The 
cost estimates might increase by poly-logarithmic factors in the case of small fields (with the 
introduction of an algebraic extension). We skip the details here, and refer for instance to 
the techniques used in ^1 El 1201 and to the references therein. 

We study the cost of the algorithms by bounding the number of field operations in K 
on an algebraic random access machine. In ^S] and |32| . ad hoc cost functions have been 
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defined for matrix polynomial problems that can be reduced recursively to matrix polynomial 
multiplication: 

log 2 d 

MM'(n,d) = ^ ^MMfn^ - * d) 

i=0 

and 

log 2 n 

MM(n,d) = ^ 4* MM (2^71, d) + n 2 (logn)B(d) 

i=0 

where B(d) is the cost for solving the extended gcd problem for two polynomial in K[x] 
of degree bounded by d. If M(d) is the number of operations in K required for multi- 
plying two polynomials in K[x] of degree d, the Knuth |23| / Schonhage |28| half-gcd al- 
gorithm allows B(gQ = 0(M(d) log d). For the scalar polynomial multiplication we take 
M(d) = 0(dlog dlog log d) 9 . The reader may refer to Chapters 8 and 11 in ^1] for more 
details and references about polynomial multiplication and gcd computation. 
For simplifying the cost results in this paper we consider either that 

MM(n,d) = 0{n"M(d)) (4) 

using the algorithm of 0, or, when the field K has at least 2d + 1 elements HUE], 

MM(n,d) = 0(n w d + n 2 M(d)). (5) 

Hence from (|IJ and © we assume that 

MM'(n,d) =0(MM{n,d)logd), MM(n, d) = 0((MM(n, d) + n 2 B(d)) logn). (6) 

Note that if to > 2 then MM(n, d) = 0(MM(n, d) + n 2 B(d)\ogn). If the assumption © is 
not made then some of our cost results that use MM(n, d) are not valid. However, we state 
our algorithms in terms of polynomial matrix multiplication; precise complexity estimates in 
terms of the ad hoc cost functions could be derived with some extra care. 

2 Previous works 

The rank and a basis for the nullspace of a matrix M G K[x] mxn of degree d and rank r may be 
computed by fraction free Gaussian elimination in 0~(nmr UJ ~ 1 d) operations in K Chap- 
ter 2]. The same asymptotic estimate may also be obtained using evaluation / interpolation 
techniques such as Chinese remaindering |14[ Section 5.5]. 

Therefore, compared to these classical approaches, we improve the cost by a factor n in 
the worst-case (2n x n full column-rank matrix). 

An elimination strategy specific to polynomial matrices is given in £ 25, that improves — 
asymptotically in the dimensions — on 0~(nmr u '~ 1 d), and computes the rank by a determin- 
istic algorithm in 0(nmrd 2 ) operations in K, but how to incorporate matrix multiplication, 
and generalize the approach to computing the nullspace, is not known. 

An alternative to the "matrix over the polynomials" approach above is to linearize the 
problem. A first type of linearization is to consider a degree one matrix of larger dimension 
with the same structural invariants (see the definition of the Kronecker indices in Section|HJ) 4 . 
A degree one matrix is a matrix pencil and an important literature exists on the topic. A 
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minimal nullspace basis of a pencil may be computed through the calculation of the Kronecker 
canonical form. To our knowledge, the best known complexity for computing the Kronecker 
form of an m x n pencil is 0(m 2 n) [31 1241 OH] . Taking into account the dimension increase 
due to the linearization we may evaluate that computing a minimal basis of M would cost 
0((md) 2 (nd)) = 0(m 2 nd 3 ). This approach is superior to ours concerning the quality of the 
output basis which is minimal. However, it is unclear how it can lead to the reduction to 
polynomial matrix multiplication that we establish. 

A second alternative and different linearization of the problem is to associate to M a 
generalized Sylvester matrix (i.e., a block- Toeplitz matrix J3J or another type of resultant. 
This has been heavily used for control theory problems and in linear algebra. A polynomial 
vector of degree 5 in the nullspace of M may be obtained from the nullspace of a block- 
Toeplitz of dimension about n5. This leads to costs too high by a factor of n when the 
degrees in a minimal nullspace basis are unbalanced. We are not aware of an approach based 
on successive compression here that would allow to save a factor n and to introduce polynomial 
matrix multiplication. 

These two types of linearization correspond to two main approaches — based on state- 
space realizations or on resultants — for the problem of coprime matrix fraction description 
or coprime factorization 17, Chapter 6]. We see from © that we will use a solution to the 
latter problem a logarithmic number of times on the compressed matrices. If all matrices 
involved are of degree d, then we use the cr-basis algorithm of pQ, and the corresponding 
reduction to polynomial matrix multiplication of j!5j . A solution of the coprime factorization 
in case of unbalanced degree is, in a way similar to the block- Toeplitz approach, is faced with 
the question of saving a factor n in the cost. Known algorithms seem to have a cost driven 
only by the highest degree in the factorization, rather than by the sum of the involved degrees 
as we propose. 

Our work is a derivation of an elimination scheme using minimal bases directly on polyno- 
mial matrices. Our compression / uncompression strategy can be compared to the techniques 
used for the staircase algorithm of [3J I26j for preserving a special structure. We somehow 
generalize the latter to the case of polynomial matrices for reducing the matrix description 
problem with input BA~ l to the polynomial matrix multiplication. 

3 Preliminaries for polynomial matrices 

We give here some definitions and results about minimal bases |13j and matrix fraction de- 
scriptions that will be used in the rest of the paper. For a comprehensive treatment we refer 
to [171 Chapter 6]. For a matrix M 6 K[x] mxn of rank r and degree d, we call (left) nullspace 
the K(x)-vector space of vectors v G K(x) m such that vM = 0. We will compute a basis of 
that space. The basis will be given by m — r linearly independent polynomial vectors, and is 
related to the notion of minimal basis of the nullspace seen as a K[x]-module. 

Definition 3.1 A basis N±, . . . , N m _ r E K[x] m with degrees 6\ < . . . < <5 m _ r of the nullspace 
of M seen as a K[x]-module is called a minimal basis if any other nullspace basis with degrees 
S'i < ■ ■ ■ < o~' m -r satisfies 5[ > 5i for 1 < i < m — r. 

In the rest of the text, "basis" will usually refer to the vector space while "minimal basis" 
will refer to the module. The degrees 8\, ... ,S m - r are structural invariants of the nullspace. 
They are called the minimal indices of the nullspace basis. The minimal indices of a nullspace 
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basis of M are called the (left) Kronecker indices of M. A polynomial matrix M € K[rc] mxn 
is called row-reduced if its leading row coefficient matrix has full rank. It is called irreducible 
if its rank is full for all (finite) values of x (i.e., I m is contained in the set of K[x]-linear 
combinations of columns of M). These two definitions are used for characterizing minimal 
bases; we refer to |17| Theorem 6.5-10] for the proof of the following. 

Theorem 3.2 The rows of N £ K[x] m_r ; such that NM = 0, form a minimal basis of the 
nullspace of M if and only if N is row-reduced and irreducible. 

A key point for keeping the cost of the computation low is the degree transfer between M 
and a minimal nullspace basis N. The McMillan degree of M of rank r is the maximum of 
the degrees of the determinants of r x r submatrices of M |17[ Exercise 6.5-9]. 

Theorem 3.3 The Kronecker indices and the McMillan degree of M satisfy 



with equality if M is irreducible. 

Proof. Let I and J be row and column index sets such that the McMillan degree of the 
submatrix M^j of M is equal to the one of M. By considering M. t j we reduce ourselves to 
the full column-rank case. Define I c = {1, . . . ,m} \ I, and the corresponding submatrices 
A = Mj t j and B = Mj c j of M. By unimodular column reduction we may assume that M. t j 
is column reduced, since A carries the McMillan degree, BA^ 1 is proper. A minimal basis 
N gives the corresponding matrices C = N. t j and D = N. j c such that CA + DB = 0. The 
matrix D cannot be singular otherwise there would exist a vector « / such that uD = 
and uC ^ (the latter since N is non-singular). This would give a non-zero vector u such 
that uA = which is not possible. Hence, D~ 1 C = BA^ 1 . If M is irreducible, then since 
is irreducible by definition, both latter fractions are irreducible. By |17L Theorem 6.5-1], 
deg det D = McMillan-deg M. Therefore, using the fact that D~ X C is proper we know that 
deg det D = Ya^i &i-> an d the Theorem is established. When M is not irreducible the same 
reasoning applies with deg det D < McMillan-deg M. □ 

As dicussed in the introduction, Gaussian elimination is far too pessimistic when it results 
in a nullspace basis with degree sum in Q(n 3 d). Theorem 13.31 shows that there exist minimal 
bases with degree sum in 0(n 2 d) whose computation should be cheaper. 

We will use minimal bases in relation with left or right matrix fraction descriptions. A left 
fraction description S' _1 A is irreducible (or coprime) if any non-singular polynomial matrix 
and left common divisor U of 5 and N (i.e., S = US' and N = UN' for polynomial matrices 
S' and N') is unimodular. An analogous definition holds on the right. 

Lemma 3.4 The rows of N = [N p S], such that NM = 0, with S non- singular form a basis 
for the nullspace as a K[x]-module if and only if S~ 1 N p is irreducible. 

Proof. We have that N is a basis if and only if it is irreducible, which in turn is equivalent 
to the fact that S and N p are coprime |17| Lemma 6.3-6]. □ 

For a rational matrix 7i we may define the K[x]-module V-h of polynomial vectors u such 
that uH is polynomial. We will use the following. 



m—r 
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Lemma 3.5 S N = TL is a coprime matrix description of TL if and only if the rows of S 
form a basis ofV-n- 

Proof. Consider T non-singular whose rows are in V-ft. Then for a polynomial matrix M we 
have TTL = TS^N = M, hence S~ X N = T~ l M. Since S^N is coprime, T is a left multiple 
of S |17l Lemma6.5-5]. Conversely, if the rows of S form a basis of Vn , then S _1 N is coprime. 
Otherwise, S would be a multiple of 5 C for S~ 1 N C coprime, which would contradict the basis 
property. □ 

In Section |H1 we will focus on computing only vectors of degrees bounded by a given 5 in 
a nullspace minimal basis. We define their number k = max{l < i < m — r s.t. Si < 5} (the 
Kronecker indices are arranged in increasing order). Corresponding vectors are called k first 
minimal vectors in the nullspace. 

Remark 3.6 We will also manipulate the module generated by k such vectors. As in Theo- 
rem l3.21 a corresponding submatrix N with k rows of iV must be irreducible. As in Lemma f3.41 
if JV = [N p S] then N p and S have no left and non-singular common divisor other than uni- 
modular. Since a minimal basis N of the nullspace is row-reduced, by the predictable-degree 
property |171 Theorem 6.3-13], any vector of degree less than 5 must be in the sub-module 
generated by k minimal vectors. 



4 Matrix fraction descriptions for the nullspace 

Let us consider a matrix M = [A T B T ] T £ K[x]( n+p ) xn of degree d as in P| ) with A square 
n x n and invertible. Our study here and in next section focuses on the case p < n which is 
the heart of the method, and where all difficulties arise. The results here remain true but are 
trivial for p > n (see Remark 16.6(1 . 

The rows of TC = [H — I p ] = [BA -1 — I p ] form a nullspace basis of M. Hence, for iV a 
minimal nullspace basis, there exists a transformation S in K(x) pxp such that STL = N . With 
the special shape of TL we deduce that S is a polynomial matrix in K[x] pxp whose columns 
are the last p columns of N . This leads to the following left matrix fraction description of TL: 

TL=[H -I p } = [BA- 1 - I p ] = S^N. (8) 

The left fraction description S~ 1 N must be irreducible otherwise there would exist another 
description TL = (S') -1 iV with N' G K[x} px ( n+P > having row degrees lexicographically smaller 
than the row degrees of N. Since N'M = this would contradict the fact that is minimal. 

For reducing the cost of our approach we will introduce a (random) column compression 
Hp of H given by 

H P = HP = BA- X P G K[x] pxp (9) 

with P € K[x] nxp . 

In order to be appropriate for computing the nullspace of M, H p must keep certain 
invariants of BA -1 . We establish in the rest of the section — see Proposition 14.21 — that there 
exists a P such that, on the left, the description H p = S~ 1 (NP) remains irreducible. With 
the same P we show the existence, on the right, of a description whose denominator matrix 
has relatively small degree. The existence of such a P will ensure that the properties remains 
true for a random compression. 
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Lemma 4.1 Let A be non-singular of degree less than d and determinantal degree v ^ in 
K[.x] nxn . Let B be in K[x\ pxn . There exists a surjective function a : K[x] nxp — > K vxp , and 
two matrices X E K pxu and A E K uxu , such that for any P in K[x] nxp 

H p (x) = B(x)A(x)- 1 P(x) = Q(x) + X(x - A )- 1 cj{P), (10) 

with Q E K[x] pxp . If P is selected uniformly at random of degree at most d — 1, then o~(P) 
is uniform random in K vxp . Additionally, a matrix S E K[x] pxp is the denominator of a left 
coprime description of BA^ 1 if and only if S is the denominator of a left coprime description 
fX{x-A o )-\ 

Proof. We first establish ()1U|) for B the identity matrix of dimension n and for A in column 
Popov form |22j (see also ^3 §6.7.2]): A is column-reduced, i.e. its leading column coefficient 
matrix has full rank; in each row of A a unique entry has maximum degree and is monic. Let 
d\, d2, ■ ■ ■ , d n be the column degrees of A, since A is in Popov form, v = Ya=i di- We first 
assume that the di's are greater than one. We follow the lines of the realization constructions 
in [T71 §6.4]. Consider D = diag(x dl , x d2 , . . . ,x dn ) and = diag([l x . ..x di ~\ 1 < i < n) E 
K nxv . Since A is in column Popov form we have A = D + ^?Al where Al E K uxn is given 
by the low degree coefficients of the entries of A. We also define X = diag([0, ... ,0, 1] E 
K lxd % 1 < i < n) E K nxu and D a = diag(C a; d 1 , C x a 2 , . . . , C x d n ) E K uxu whose diagonal blocks 
are matrices companion to the diagonal entries of D. One can directly check that ^>{x — D ) = 
DX. Taking A Q = D Q - A L X we get *(z - A a ) = ^>(x -D Q + A L X) = DX + $>A L X, hence 
*$>(x — A Q ) = AX, or, in other words, 

A' 1 * = X(x - A )-\ (11) 

If the row degrees of P are strictly lower than the di's then P may be decomposed into P{x) = 
^P . This leads to A~ l P = X(x — A )~ l P and we take o~(P) = P . If P has larger degrees, 
dividing P by A uniquely defines two polynomial matrices Q and R such that R = P — AQ 
and such that the row degrees of R are less than the d^s (see |17| Division Theorem 6. 3- 15]). 
Writing R = ^i? we get A~ l P = A~ l {AQ + R) = Q + A~ l R = Q + X(x - A )- l R and we 
take cr(P) = R a . 

Now, if some column degrees are zero, say exactly k of the d^s, then for row and column 
permutations Ui and U r and since A is in Popov form, we may write 



UlAUr 



A A 12 
/ 



where A E K[x] ( ' n_ ' c ^ x( ' n_fc ^ has column degrees greater than one and A12 is a constant matrix 
in \<S n ~ k ) xk . Applying (dU to A we get matrices ^, X and A Q such that A' 1 ^/ = X^-Ao)' 1 . 
Hence, if \I/ and X are constructed by augmenting ^ and X with k zero rows, we get 



(A~ L Uf )^ = U r 



A- 1 -A- X A 12 
/ 



* = U r X(x- Ao)- 1 . (12) 



Then a may be defined as previously, if R = ^>R is the remainder of the division of U\P by 
UiAU r , then a(P) = R Q . 

If R , with R = Ur tyR , is the image of a matrix P of degree less than d — 1, we have 
P = R + AQ. For another matrix R' Q E K uxp , with R' = ^R' a , this defines a unique matrix 
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P' = R' + AQ of degree less than d — 1 such that cr(P') = R' Q . Hence any two matrices in 
K uxp have the same number of inverse images of degree less that d — 1 by a. Together with 
the fact that the restriction of a to the matrices of degree less than d — 1 is surjective, this 
shows that a uniform random choice of P of degree less than d — 1 leads to a uniform random 
choice o-(P) in K uxp . 

For general matrices A £ K[x] nxn and B £ K[x] px ", let 1/ be unimodular such that 
A = AV is in Popov form. From the above we know that 

A{x)- l P{x) = Q{x) + X(x - A )- l a{P). 

Taking X = B(x)V(x)X — Qb(x)(x — A Q ) the remainder of the division of B(x)V(x)X by 
(x — A ) this leads to 

B(x)V(x)A( X y 1 P{x) = B(x)V(x)Q(x) + Q B {x) + X{x - A )- l a{P) 

which is 

B(x)A(x)- 1 P(x) = Q(x)+X(x - A )~ 1 a{P) 

where Q is a matrix polynomial and X is a constant matrix as the remainder of a division by 
a matrix of degree one. This establishes ()1U|) with an appropriate a. 

It remains to show the property on denominator matrices S. We use Lemma 13.51 and 
prove that SBA^ 1 and SX(x — A Q )~ l are polynomials for the same denominator matrices S. 
In (|12|) the matrix [I n -k 0] T is a submatrix of "if. Therefore A^ 1 and A~ ly & are polynomials 
for the same polynomial matrices SBV (B and V are fixed), and SB A -1 and SBA -1 ^ are 
polynomials for the same S. Finally notice that SX(x — ^4 ) _1 is polynomial for the same set 
of matrices S since X(x — A ) _1 is the fractional part of BA -1 ^. □ 

We now state the required properties for P, and prove them on the realization (|10|) . 

Proposition 4.2 Let A £ K[x] nxn be non-singular of degree less than d and determinantal 
degree v, and let B £ K[x] pxn . Assume that S £ K[x] pxp is any denominator of a left 
irreducible fraction description of BA^ 1 . Then there exists a matrix P of degree less than 
d-lin K[x] nxp such that 

H p = BA^P = CT- 1 (13a) 
= S^Np £ K[x] pxp (13b) 

where CT~ l is a right irreducible description with T £ K[j;] pxp of degree less than \v jp~\ < 
{n/p)d+ 1, and where S~ l N p is a left irreducible description. 

Proof. For u = (BA^ 1 is a polynomial), the results hold with T = S = I. In the general 
case Lemma 14. II gives 

H p (x) = B{x)A{xY l P{x) = Q(x) + X(x - A )' l a(P). 

For studying denominators of irreducible descriptions of H p one can forget its polynomial 
part, hence we now focus on the fraction X(x — A )~ 1 a(P). Lemma 14. II also gives that there 
exists a left irreducible fraction description of X(x — A )~ l with denominator S: 

S(x)- l N\x) = X(x-A )- 1 . (14) 
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Through the application a, choosing an adequate polynomial P £ K[x] nxp for H p reduces to 
choosing an adequate constant Y E « nxp for X(x — A )~ l . 

We now use the formalism of minimum generating polynomials of matrix sequences in- 
troduced in |331 I34| and |21l §2]. By Lemma 2.8 in |2J, finding a matrix Y such that 
X(x — A )~ 1 Y = C'(x)T(x)~ 1 with T as expected, reduces to finding an appropriate Y 
with T the a right minimum generator of the sequence {XA l Y}i>Q. From (|14[) we have 
that S is a left minimum generator of {XA }i>Q. Therefore one may use the construction 
of |331 Corollary 6.4], together with |21l Theorem 2.12]. This provides a Y and a right mini- 
mum generator T of {XA a Y}i>o with determinantal degree equal to the determinantal degree 
[i of S, and with degree bounded by \n/p\ < \v/p\. A matrix P of degree d—1 such that 
cr(P) = Y is an appropriate choice for concluding the proof of Q13a|) . Indeed, C = QT + C 
and T gives an appropriate right irreducible description. The corresponding left description 
S^ 1 N p is coprime by |171 Lemma 6.5-6], which establishes (|13b[) . □ 

Proposition 14.21 shows that if P has symbolic entries, then a right coprime description of 
Hp = BA~ 1 P = CT~ l can be found with a denominator matrix of degree less than d, and 
with the same left denominators as for BA^ 1 . 

Remark 4.3 Proposition l4.2l establishes the existence of appropriate descriptions S~ 1 N p and 
CT^ 1 for a symbolic P. As a consequence of Lemma 14.11 |3*3 , Corollary 6.4] or |21| Section 
2], and by evaluation |12l 1351 the same denominator properties will hold for a random 
matrix P. 

5 From compressed minimal bases to minimal bases 

As seen in Introduction, we will compute a small basis for the nullspace of the input matrix 
as a set of successive minimal bases of matrices like in (J2J). The latter minimal bases are 
computed in two main steps. We first compute the expansion of H p = BA~ 1 P and reconstruct 
a corresponding fraction (j3J) with denominator S. Then, if P is such that H p satisfies (|13b[) . we 
know that S[BA~ l - I p ] is a polynomial matrix N, which by construction satisfies NM = 0. 

In the spirit of the scalar polynomial case and of for the matrix case, the reconstruction 
may be done via Pade approximation, and through the computation of particular bases of 
the nullspace of [—I p H p ] T . Indeed we have the equivalence between S~ l N p = H p and 
[N p S] • [— I p Hp] T = 0. Hence the purpose of this section is to identify the bases of the 
nullspace of [Hp — I P ] T that actually lead to minimal bases N for M. 

Through a conditioning of M let us first specify the location of the leading degree terms 
in the latter bases (see Theorem 13.3(1 . 

Lemma 5.1 For M as in 0) there exist a matrix Q G \<S n+ P)^ n +P) such that the McMillan 
degree of the top n x n submatrix of QM is equal to the McMillan degree of QM (and of M ). 
This implies that if N is a minimal basis of the nullspace of QJ\d ? then S — N.^p-\-\ t Tl +p is 
row-reduced with row degrees the Kronecker indices Si,...,5 p . 

Proof. If / is a set of row indices such that Mj t . has determinantal degree Ya=i ^ an< ^ ^ 
Q £ y^( n +P) x ( n +p) be a row permutation tt such that vr(I) = {1, . . . , re}. Then the top re rows of 
QM give the McMillan degree. From [2J Theorem 5.1 (b)] the dominant degrees in a minimal 
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basis of the nullspace of QM are in the columns {1, . . . ,n+p}\{l, ... ,n} = {n + 1, . . . ,n+p}. 
□ 



Remark 5.2 The property given by the multiplication by Q in Lemma 15.11 will hold for a 
random Q over K (compare to Remark 14. 3|) . 

In next sections, nullspace vectors v T for M are easily obtained from nullspace vectors 
w T for QM, indeed v T = w T Q satisfies v T M = w T QM = 0. This conditioning of M — and 
implicitly of N — will alllow us to compute S, and then deduce N, from a shifted minimal 
basis for the nullspace of [— I p HT] T . Shifted bases are defined as usual minimal bases by 
changing the notion of degree. For i a fixed multi-index in Z m , the t-degree of a vector v in 
K[x] m is 

i-deg v = max {degUj — ij}. (15) 

l<i<m 

Definition 5.3 A basis of a K[x]-submodule of K[x] m , given by the rows of a matrix N, is 
called i-minimal if N is row-reduced with respect to the i-degree. Equivalently, N ■ x~ l is 
row-reduced with respect to the usual degree (see JU Definition 3.1]). 

For t = [0, . . . , 0] the definition corresponds to the usual definition of minimal bases. The 
value i = [(d — 1) P ,0 P ] below, where (d — l) p and P respectively denote the values d — 1 
and repeated p times, is chosen from the degree d — 1 of the compression matrix P of 
Proposition 14.21 This value forces the row reduction in the last columns of the bases. 

Proposition 5.4 Let M € K[x]( n+p ) xn be of full rank such that the matrix S, formed by the 
last p columns of a minimal basis N for its nullspace, is row-reduced with row degrees the 
Kronecker indices 5\, ... ,5 p . Assume that P G K[x] nxp satisfies I13b\) . Lett = \{d— 1) P ,0 P ] £ 
N 2p . Then [N p S] is a i-minimal basis for the nullspace of [—I p Hp] T if and only if 
N = SlBA^ 1 — Ip] = [N S] is a minimal basis for the nullspace of M. 

Proof. We first prove that the condition is sufficient. If [N S] is a minimal basis for the 
nullspace of M, the description S^iV of BA -1 is irreducible fLemma 13. 4|) . The rows of 
[N p S] = [NP S] are in the nullspace of [—Ip Hj] T . They form a basis of the latter 
nullspace since otherwise S _1 N p would not be irreducible which would contradict (|13b|) . We 
assume that the rows of the bases are arranged by increasing degrees. The ith row of NP 
has degree less than 8{ + d — 1, hence its t-degree is less than 5i, which in turn is less that the 
t-degree of the ith row of S. Which shows that [N p S] is row-reduced with respect to the 
t-degree since S is row-reduced by assumption on M and by Theorem 13 .2|) . The t- minimality 
follows. 

Conversely, if [N p S] is a t-minimal basis for the nullspace of [— I p Hp] T , then by (|13b|) 
iV = S^A^ 1 I] = [N S] is a polynomial matrix, and N p = NP. Since [N p S] is a basis, 
S^-ZVp is irreducible (Lemma 13. 4j) . hence also by (|13b|) . S^iV is irreducible and [N S] is a 
basis for the nullspace of M. It remains to show that [N S] is row-reduced. There exists 
a unimodular p x p matrix U such that [N S] = U[L R] where [L R] is a row-reduced 
basis for the nullspace of M, hence where R is row-reduced by assymption on M. By the 
predictable-degree property ^3 Theorem 6.3-13], the degree of the ith row of S is degS 1 , = 
maxj = i : ,,^p{5j +deg Uij}. The degree of the ith row of N is deg N < maxj = i v .. j p{5j +deg Uij}. 
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The i-degree of the ith row of N p may then be bounded as follows, 

t-deg ((N p )i) = deg((NP)i) - (d - 1) < max {Sj + degUy} < degS; = i-deg S t . 

j=l....,p 

Since [N p S] is row-reduced with respect to the t-degree, this implies that S itself is row- 
reduced. By assumption on M the degrees of S are dominating in [N S], hence the latter 
matrix also is row-reduced and is a minimal basis for the nullspace of M. □ 

For compressing matrices P which satisfy (|13b|) . Proposition 15.41 establishes strong links 
between the nullspace of [—I p H p ] T and the one of M. In particular, [— I p H p ] T and M have 
the same Kronecker indices. For any given 5, there is a one-to-one correspondence between 
the vectors of ^-degree 5 in the nullspace of [—Ip H p ] T , and those of degree S in the nullspace 
of M. This is seen from the U S" common part of the bases. 



6 Computing nullspace minimal vectors 

We still consider a full column-rank matrix M be of degree d as in (JJ). Let 5 be a fixed 
integer and k(= k(5)) be the number of vectors of degree less than S in a minimal basis N of 
the K [x] -nullspace of M. In this section we study the cost for computing k such vectors. 

Algorithm Nullspace minimal vectors (M,S) 

Input: M € K[x]( n+p ) xn of degree d, a degree threshold 5, 

M has full column-rank. 
Output: k = max{l < % < p s.t. Si < 5}, 

independent vectors Ni £ K[x] n+P of degree Si, 1 < i < n, in the nullspace of M. 

(a) M := QM for a random Q G K( n +f) x ( n+ P); 

(b) M := M(x + xq) for xq random in K; 

A := Mi__ nt i__ n , if det^4(0) = then fail; /* rank M is probably less than n */ 
B := M n+ i.. n+P) i.. n ; 
rj := 5 + d + [nd/p]; 

(c) H := expansion of BA~ l mod x v ; 

(d) H p := HP for P random in K[x] nxp of degree less than d — 1; 
i=[(d- l) p , P ] = [d - 1, . . . d - 1, 0, . . . , 0] G N 2 P; 

(e) L := [N p S] := a cr-basis with respect to t for [—I p H p ] T of order rj; 

(f) k := the number of rows of [Ap 5] of t-degree at most S; 

select the corresponding k rows 5j of S by increasing degrees, 1 < i < k; 

(g) Ni := Si[H - I p ] mod x 5+1 , 1 < i < k; 
A^(x) := iVi(x - x )Q, 1 < i < k; 

A : = #{Ni s.t. iVjM = 0} 

(h) if A 7^ k then fail; /* certification of k * / 

:= the k x (n + p) matrix whose rows are the A^j's; 

(i) if is not row-reduced then fail; /* certification of the minimality */ 
else return k and Ni, 1 < % < k. □ 

Algorithm Nullspace minimal vectors starts with lifting on a compressed matrix (Propo- 
sition I4.2|) . Then it partially (subject to the degree threshold) computes a denominator 
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matrix S through a partial i-minimal basis computation. Using Proposition 15.41 the target 
nullspace vectors are finally obtained. 

We prove the algorithm and its cost in the rest of the section. Step (a) is the conditioning 
seen in Section|S]to ensure the degree dominance of the last p columns of N. Together with the 
randomized compression of Step (d) studied in Proposition this will allow the computation 
of S at Step (e). Step (b) is a randomized choice for working with a matrix A non-singular at 
x = 0. The latter condition is required for computing at Step (c) the expansion of BA -1 by 
lifting [311 I32| . Step (e) partly reconstructs a description S~ 1 N p from a truncated expansion 
of Hp. The computation is explained in Lemma 16.31 below, and the selection of small degree 
rows at Step (f ) is justified. Our approach for the reconstruction is very close to the column 
reduction of ^3 §3]. A degree less than 8 in S corresponds to a i-degree (see (|15)l) less than 8 
in [N p S] (the compression using P increases the degree in N p by d — 1), and to a degree less 
than 8 in N. Step (g) applies Proposition 15.41 for partly reconstructing the nullspace of M, 
and Steps (h) and (i) certify the outputs. 

The partial reconstruction of H p (i.e. the computation of a i-minimal basis at Step(e), 
and of the denominator matrix S at Step (f)) is done using a minimal "nullspace basis 
expansion" — or cr-basis pQ. We generalize §3] and §4.2] especially for the partial 
computation aspects. 

Definition 6.1 Let G be in K[[x]] gxp . Let t be a fixed multi-index in HP. A a-basis of 
(matrix-) order d with respect to t for G is a matrix polynomial L in K[x] qxq such that: 
i) L(x)G(x) = mod x d ; 

l\) every v G K[x] q such that v(x)G(x) = 0(x d ) admits a unique decomposition v T = 
Sf=i a iLi where, for 1 < i < q, Li is the ith row of L, and on is a scalar polyno- 
mial in K[x] such that degaj + t-deg Lj < t-deg v. 

The reader may notice that we have slightly adapted the notion of order of the original 
Definition 3.2 of pQ for a fully matrix point of view. We also use the notion of shifted degree 
(see [2]) equivalently to the notion of defect used in ^ Definition 3.1]. The following shows 
that a a-basis to sufficiently high order contains a minimal basis. 

Lemma 6.2 Let us assume that a minimal nullspace basis of G has k vectors of i-degree at 
most 5, and consider a a-basis L with respect to i. For an approximation order greater than 
5 + 1, at least k rows in L have i-degree at most 8. 

Proof. See the proof of |16[ Proposition 5] . We consider the k rows of degree less than 5 in 
a minimal nullspace basis of G. We order them by increasing degrees 61,62, ■■■ ,S K . The first 
row v\ has degree 5i therefore by 11) of Definition 16.11 vi can be written as 



We deduce that one row of L has f-degree at most 81. Now if L has i — 1 rows of degrees 
81, ... , 8i-i, with Vi of t-degree 8i, then the same reasoning as for vi shows that L has a row 
of degree less than 8i, linearly independent with respect to the first i — 1 chosen ones. The 



Next lemma identify the situation when a u-basis will give the exact information we need. 
We assume that we are in the situation of Proposition 15. 4| in particular S in the minimal 




OLiLi, with deg«j + i-deg Lj < t-deg vi = 81. 



proof is concluded with i = k. 



□ 
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bases has row degrees Si, . . . ,S p , the Kronecker indices of M and of [— I p H^] T . We fix a 
value 5 and define k = max{l < i < p s.t. <5j < 5}, and i=[(d— l) p , P ] G N 2p . 

Lemma 6.3 Lei us assume we are in the situation of Proposition \5.4\ Let L be a a-basis 
for [—Ip Hp] T , with respect to i, and of order of approximation at least r\ = 5 + d + \nd/p] . 
Then exactly k rows of L have i-degree at most 5, are in the nullspace of {—Ip Hp] T , and 
have i-degrees Si, . . . , 5 K . 

Proof. We generalize the proof of |151 Lemma 3.7] to the partial computation of the basis, 
and to the shifted case. We first verify that at most k rows of L have i-degree less than S, 
then we prove their existence. Note that the rows of L are linearly independent 

Let Li = [Li Si] € K[x] 2p be a row of L of i-degree at most S. From i) in Definition 16.11 

Si(x)H p (x) = Li(x) mod x v , 

and from the assumption (|13aj) on P, 

Si{x)C{x) = Li(x)T(x) mod x v . (16) 

We now look at the degrees in both sides of latter identity. We have deg Si = i-deg Si < 5. 
By assumption on M, the degree of BA^ 1 is at most zero, hence the degree of H p is at most 
d — 1. The latter is also true for CT _1 in ()13a|) . which implies that degC < degT + d— 1. 
Using the degree bound on T in Proposition 14.21 the left side term of (fl6|) thus have degree 
at most rj — 1. In addition, deg Li = i-deg (Li) + (d — 1) < S + d — 1. Hence both sides in (|16j) 
have degree at most rj — 1 and we deduce that 

Si{x)C{x) = Li{x)T{x). (17) 

It follows that Li = [Li Si] is in nullspace of [—I p Hp] T ■ Using the equivalence with 
the nullspace of M in Proposition 15.41 one may associate to = [Lj Si] a row vector 
Ni = [N% Si], with NiP = Li, of degree less than 5 in the nullspace of M (the "S" part is 
row-degree dominant). Since the rows Li are linearly independent, the rows Ni of degree less 
than 5, corresponding to the Lj's of t-degree less than S, are linearly independent. At most k 
such rows can exist. 

We now show that n rows of i-degree at most 5 exist in L. We consider the k rows of 
degrees Si, . . . , S K in a minimal basis N = [N S] of the nullspace of M. They give k rows of 
i-degree at most 5 in the nullspace of [— I p Hj] 7 '. Using Lemma l6~21 thev lead to k rows of 
i-degree at most 8 in L, which are in the nullspace by (|17|). hence their i-degrees are Si, . . . , 5 K 
by minimality. Note that the linear independency in N is preserved for the nullspace of 
[—Ip Hp] T since the column-reduced part S is in common. □ 

Proposition 6.4 Let M S K[x]( n+p ) xn be of full column-rank with Kronecker indices S±, . . . ,5 P 
Algorithm Nullspace minimal vectors with inputs M and 5 £ N returns k = max{l < % < 
p s.t. Si < S}, and k first minimal vectors of the nullspace of M. The algorithm is random- 
ized, it either fails or returns correct values (Las Vegas fashion). 

Proof. We first verify that if the random choices of xq, Q and P work as expected then 
the result is correct. We will then prove that if the algorithm does not return fail then 
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we are in the previous case. Note that the random shift xq does not modify the problem. 
Indeed, rankM(x) = rankM(x + xq), and since a matrix whose rows form a minimal basis is 
irreducible, the Kronecker indices are invariant under a shift. 

Using Lemma 15.11 the role of Q is twofold: the top n x n submatrix of M becomes non- 
singular, and the dominant degrees in the nullspace are in the last columns. If det^4(0) 7^ 
then the rest of the computation is valid, in particular the expansion of BA^ 1 at Step(c). 
The basis L of order r\ as required can be computed from the expansion of BA~ l to the 
order r/ ^ ^1 • If the choices of Q and P are successful then Lemma 16.31 ensures that the 
value of k is correct; the corresponding rows of L are in the nullspace of [— I p Hp] T . The 
nullspace correspondence of Proposition 15.41 then shows that Si[BA~ l — I p ] is a polynomial 
row of degree less than 5, hence the computation of N can be done modulo x s+1 . 

We now study the certification of the outputs. If det A(0) 7^ then we know that M has 
full column-rank. The algorithm may then potentially fail with respect to the output value 
k, there could actually be less or more minimal vectors of degrees at most 5. It may also 
fail with respect to the minimality of the output vectors. In any case, the computation of A 
ensures that the returned N's are in the nullspace. 

To avoid confusion we now denote by k the output value and keep n for the correct 
(unknown) value. Let us first see that k > k. Indeed, to the k rows Ni = [N Si] of 
degree less than 5 is in the nullspace of M, one may associate k rows [NP Si] of t-degree 
less than 5 in the nullspace of [—I p H p ] T ■ Since det A 7^ 0, we know that the S^s are 
linearly independent. Hence we have k linearly independent rows of t-degree less than S in 
the nullspace of [— I p H^] T . Then by Lemma f6.21 there must be k q > k rows of t-degree 
less than 5 in L. If A = k q then we have found k linearly independent rows (from the Si's) 
of degree less than 5 (the degree is forced by construction at Step (g)) in the nullspace of M 
(test at Step (h)), hence k q > k cannot happen, and k q = k. The returned value k is always 
correct. In the latter case the returned vectors are linearly independent in the nullspace and 
satisfy the degree constraint. 

We finally show that the returned vectors must be minimal. The corresponding k rows, 
say Li = [Li Si] for 1 < i < k, in the nullspace of [—Ip Hp] T , must be minimal. Otherwise, 
by 11) of Definition 16. 11 a row of smaller t-degree would have been selected in L. In particular, 
the matrix formed by the Lj's and the one formed by the Si's are left relatively prime (no 
common left divisor other than unimodular). The k computed rows Ni = [N Si] satisfy 
NP = Li, hence the matrix formed by the iVj's and the one formed by the S^s are also left 
relatively prime. Let be the k x (n + p) matrix whose rows are the computed iVj's, and 
let JVW be a k x (n+p) matrix whose rows are K first minimal vectors for the nullspace 
of M. Then the primality implies that there exist a unimodular U such that No^ = UN^ 
(see Remark 13. 6j) . Therefore the rows of No^ have minimal degrees if and only if N^ is 
row-reduced. The check is made at Step (i). □ 

From the arguments used in the proof of Proposition 16.41 we see that the algorithm may 
fail because the computed value k is too large. This will essentially happen for bad choices of 
P, when the nullspace of the compressed matrix (see (|13b|0 . and the approximating cr-basis 
(see (|13a|l ). does not reflect the nullspace of M correctly. Then, even for correct values of k, 
the minimality may not be ensured without the test at Step (i). A bad choice of Q, depending 
on P, may lead to a row reduction in the non-dominant part of the basis (see Lemma l5.1|) . 
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and to a loss of minimality (see Proposition 15.41) * . A correctly computed value of k may lead 
to a smaller value A after the truncation (g) of a non-minimal vector. 

We also note that the minimality condition could be relaxed in the algorithm. Avoiding 
the last certificate would lead to the Las Vegas computation of k independent vectors (possibly 
non-minimal) in the nullspace. 

Corollary 6.5 Let M € K[x]^ n+p ) xn be of full column-rank and degree d with 1 < p < In, and 
let d < b < nd. Minimal independent vectors in the nullspace of M , of degrees the Kronecker 
indices less than b, can be computed by a randomized Las Vegas (certified) algorithm in 

0(\pb/nd] MM(n,d)logn + (n/p)MM(p,b) + MM(p, b) log b + n 2 B(d) log n) 

operations in K. The cost is 

0(MM(n,d)\og(nd) + n 2 B(d) log n + nM(nd)) (18) 

whenp5/(nd) =0(1). 

Proof. We use either (0J) or (JSJ), and the corresponding simplifications © for studying the 
cost of Algorithm Nullspace minimal vectors. 

Steps (a) and (b) uses 0(MM(n, d) + n 2 M(d)) operations. From Proposition 15], the 
cost for computing the expansion H is 0(log(rj/d)\pr]/nd~\MM(n,d) + MM(n, d)). This gives 
0((\(p5)/(nd)~\ MM(n,d) + n 2 B(d))logn) for rj = 0(b + nd/p). Step (d) is a polynomial 
matrix multiplication that can be done in 0(MM(n,d)) operations. For the computation 
of the cr-basis at Step (e) we use the algorithm of ^1 §2] based on polynomial matrix 
multiplication. The corresponding cost from |151 Theorem 2.4] is 0(MM'(j>, 77) + ryMM(p)), 
hence 0(MM(p, b) log b), or 0(MM(n, d) log d) if pbjnd = 0(1). Step (g) is a polynomial ma- 
trix multiplication modulo x s+1 that can be computed in (n/p)MM(p,b) operations, this is 
0(MM(n, d) log d + nM(nd)) when pbjnd = 0(1). The shift of the N^s is done in at most 
0(52i=i n M((5j)) operations, which is less than 0((n/p)MM(p, 6)), or than 0(nM(nd)) for 
pbjnd = 0(1). The subsequent multiplication by Q has lower cost. Then we compute N%M 
for 1 < i < k, where N{ has degree <5j, and Yji=\ &i — n< ^- D° m g this computation directly 
as the product of a k x (n + p) matrix with possibly large degrees, by an(n+p)xji matrix 
of degree d would be too expensive. Instead, we split the large degree entries of the A^'s 
and form an n x (n + p) matrix iV of degree d, and recover the products N^M from the 
multiplication NM. The corresponding cost is 0(MM(n, d)). The final check (i) is done in 
0(n u + n 2 d) operations. □ 

We see from (j!8j) that computing vectors in the nullspace at essentially the cost of mul- 
tiplying two polynomial matrices relies on the compromise between p and b. The algorithm 
is a combination of matrix lifting and matrix fraction reconstruction. Many vectors of small 
degrees are computed using lifting to a limited order and large matrix reconstruction. Con- 
versely, few vectors of large degrees are computed from a high-order lifting and reconstruction 
with matrices of small dimensions. 

Remark 6.6 Note that the random compression P is introduced for p < n. Still, the algo- 
rithm is proven for p > n. In the latter case however, for the sake of simplicity, one may work 
directly with H p = H at Step (d) . 

*An improvement would be to combine both conditionings into a unique one with three different effects, 
left and right fractions for H p , and location of the dominant degrees. 
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7 Small degree nullspace basis computation 



Corollarv l6.5l which uses for Q18|) a compromise between p and 5, does not directly allow a 
low-cost computation of large degree vectors in a nullspace of large dimension. For the latter 
situation, and for computing a whole set of linearly independent vectors in the nullspace 
of a matrix M in K[x]( n+q ^ xn , we need to successively restrict ourselves to smaller nullspace 
dimensions (while increasing the degree). Here we take the notation m = n+q for M as in 
We keep the notation p for submatrices (J2J), and successive compressions, as in Sections IHIdI . 

7.1 Full column-rank and n < m < 2n case 

Let M G K[x] ( - n+g ) xn with 1 < q < n be of degree d and rank n. The way we restrict ourselves 
to smaller nullspaces is derived from the following observation. Let C be in \<S n+v '> x ^ n+q ^ with 
1 < p < q. If CM G K[x]( n+p ) xn also has full column-rank, then let 5\, . . . , S p be its Kronecker 
indices, and with the degree threshold 5 = 2nd/p take k{5) = max{l < i < p s.t. <5j < 5}. 
Since Y2i $i — n d, at most nd/5 = p/2, hence |_p/2j , vectors in a minimal basis of the nullspace 
of CM may have degrees more than 5, therefore k(S) > \p/2~\. From at least p/2 minimal 
vectors D\, . . . , D K G K[x] n+P of degrees at most 2nd/ p in the nullspace of CM, we obtain k 
corresponding vectors Ni = DiC £ K[x] n+q in the nullspace of M. 

Algorithm Nullspace2 n (Af ) 

Input: M G K[x]( n+g ) xn of degree d, 

M has full column-rank and 1 < q < n. 
Output: q "small" linearly independent polynomial vectors in the nullspace of M. 

M := QM for a random Q G K^ n+ ^ x( - n+q ">; 

if det Mi n i n ( x o) = for xq random in K then fail; 

i = {}; 

p := q; 

while #1 < q 

(a) {ii,...,i p }:={n + l,...,n + q}\ I; 

(b) 5 := 2nd/p; 

(c) construct C G K( n +p)^ n +*) with C M := 1, 1 < % < n, C n+i)i . := 1, 1 < j < p, 

and Cjj := otherwise; 

(d) M := CM G K[x]( n+ f) xn ; 

(e) {k, {Di, 1 < i < k}} := Nullspace minimal vectors (M, 5); 

= DiC, 1 < i < k; 

(f) JVW := the k x (n + q) matrix whose rows are the JVj^'s; 

(g) J := k column indices greater than n + 1 such that N\^ K) j is non-singular; 

(h) I := I U J , p := p — k; 

(i) iV := [iV T (iV( 5 )) T ] T ; /* update the nullspace */ 
N := NQ; 

return Ni, 1 < i < q. □ 

Algorithm Nullspace2 n is proven in Proposition 17.11 below. Let us first give the general 
idea. For computing the whole nullspace, the algorithm generates a sequence of decreasing 
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dimensions p at Step (h) . Using the observation made previously, each time the algorithm 
passes through the "while loop" the dimension is divided by at least two, hence at most 
0(log 2 q) stages are necessary. This corresponds to 0(log 2 q) calls to Nullspace minimal vectors 
with input CM. Each time the dimension is decreased, the degree threshold is increased in 
the same proportion at Step (b), we preserve the invariant 

p 5/(nd) = 2. (19) 

The latter identity will be used for applying the cost estimate (j!8j) of Corollary 16.51 

The proof of Proposition 17.11 will check that q vectors in the nullspace are actually com- 
puted. In addition, the algorithm has to ensure their linear independency. The latter is done 
on the fly, and will first rely on the initial conditioning with Q for working with a top n x n 
non-singular submatrix. The vectors for updating the nullspace are computed at Step (e) and 
Step (f) in the nullspace of Mj l n , with I = {1, 2, . . . , n, i\, . . . , i p }. This is done through 
the construction of the compression matrix C at Step (c) which selects the corresponding rows 
of M. The choice of the indices i 2 , ■ ■ ■ , i p } at Step (a), complements the index choices at 
Step (g) that are kept in / at Step (h) for previous stages, and will provide the linear indepen- 
dency by construction. Another perhaps simpler strategy for ensuring independency could 
be based on randomization. 

Our approach is "greedy", all vectors of degree under the threshold 5 are kept. It is 
unclear how using a formal "divide and conquer" would make a difference. 

Proposition 7.1 Let M G K[x]^ n+9 ^ xra with 1 < q < n be of full column-rank. Algorithm 
Nullspace2n computes q linearly independent polynomial vectors in the nullspace of M . If M 
has degree d then the sum of the degrees of the output vectors is less than nd [log 2 q~\ ■ The 
algorithm is randomized, it either fails or returns correct values (Las Vegas fashion). 

Proof. The initial multiplication by Q and the corresponding failure test ensure that the top 
n x n matrix of M is invertible when the algorithm enters the "while loop" (if the algorithms 
fails then M probably has rank less than n). At Step(f), k vectors in the nullspace of M 
are computed, indeed, D{M = DiCM = directly gives Nf ] M = DiCM = 0. The number 
of elements of / is increased by k at Step(h), hence is equal to the current total number of 
computed vectors. Since k < q — #/, if the algorithm terminates then exactly q nullspace 
vectors are obtained. In addition we have already seen that k is at least [p/2], therefore, if 
we denote by p new the new value of p at Step (h), we have p new < \j>/2\ , which means that the 
algorithm terminates after having passed through the "while loop" at most [log 2 q~\ times. 

Algorithm Nullspace minimal vectors returns k linearly independent row vectors D{ G 
K[.x] n+P at Step (e). Let D be the n x (n+p) matrix whose rows are the ZVs. We respectively 
denote the kth column of and D, by N ^ and D.^- The constrution of C leads to: 

Nf. = D. >n+j , if 1 < j < p, (20a) 
= 0, otherwise. (20b) 

Since the top n x n matrix of M, and consequently the one of M, is non-singular, k linearly 
independent columns may be found among the last p columns of D. Therefore, from (|20a[) . 
k linearly independent columns J may be found among the columns i\, . . . ,i p of This 
shows that Step (g) is valid. In addition, at subsequent stages, from Step (a) and (|20b|) . the 
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non-zero columns involved between n + 1 and q will be outside J, the corresponding nullspace 
vectors will thus be linearly independent from iV- , 1 < i < «. At each stage the N^'s are 
linearly independent, and are independent from those computed subsequently, hence we have 
proven that the algorithm returns q linearly independent nullspace vectors. 

Each of the times the algorithm passes through the "while loop" , the sum of the degrees 
of the computed vectors is bounded by the sum nd of the Kronecker indices. Indeed, these 
vectors are minimal for the nullspace of the submatrix M. Hence the sum of the degrees in 
output is less than nd |~log 2 q~\ ■ □ 

The computed vectors ZVs are minimal in the nullspace of CM but the minimality is 
not preserved in general for the vectors N^s in the nullspace of M. The output basis for the 
nullspace as K(x)-vector space may not be a basis for the K[x]-module. However, Proposi- 
tion 17.11 shows that if the sum of the Kronecker indices is nd (the maximum possible) , then 
the sum of the computed degrees is only within |~log 2 q~\ times the optimum. We notice also 
that the vectors computed at the first stage are minimal vectors by Proposition [H3J hence the 
algorithm reaches the optimum for a generic matrix M (the whole nullspace is computed with 
p = q). It would be interesting to study the loss of minimality compared to the Kronecker 
indices in the general case. 

We also remark that the algorithm could be slightly modified for computing a row-reduced 
nullspace matrix N. The intermediate bases matrices D € K[x] KX ( n+p ) whose rows are the ZVs 
are row-reduced by Proposition 16.41 By Lemma 15.11 the dominant degrees are in the last p 
columns. The column index selection of Step (g) may be specialized for choosing indices 
corresponding to dominant degrees. From there, the proof of Proposition 17. II for establishing 
that the computed vectors are independent may be extended to the fact that the output 
matrix TV is row-reduced. This could be certified at the end of the Algorithm Nullspace2 n as 
done at Step (i) of Algorithm Nullspace minimal vectors. 

Corollary 7.2 Let M £ K[x]( n+9 ) xn be of full column-rank and degree d with 1 < q < n, q 
polynomial vectors whose degree sum is less than nd\log 2 q~\ can be computed in 

0((MM(n,d)\og(nd) + n 2 B(d) log n + nM(nd)) log q) (21) 

operations in K by a randomized Las Vegas (certified) algorithm. 

Proof. We study the cost of Algorithm Nullspace2 n - The conditioning with the matrix Q 
and the failure test use at most 0(MM(n,d)) operations. We claim that the dominating cost 
is the body of the loop is the call to Algorithm Nullspace minimal vectors. Since 0(logq) calls 
are sufficient, and since p5/(nd) = 2, (|21|) is a consequence of (fT%|) in Corollary 16.51 Step (d) 
is the extraction of a submatrix. The computations N-^ = DiC G K[x] n+9 , for 1 < i < k, 
can be done in 0(n 2 d) since the degree sum of the N^'s is less than nd. The choice of k 
column indices at Step (g) can be made in 0(n u + n 2 d) operations. □ 

7.2 General case 

We now work with a general matrix M G K[x] mxn of degree d. We compute the rank r of 
M and m — r linearly independent and "small" polynomial vectors in the nullspace. Our 
strategy first uses Monte Carlo techniques for computing a value ro < r, equal to r with high 
probability. 
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Lemma 7.3 Let M be in K[x] mxn of degree d. A matrix M G K[x] mxr ° of degree d and full 
column-rank with ro < r , such that with high probability ro = r and its nullspace is equal to 
the nullspace of M, can be computed in 0(nmMM(r,d)/r 2 ) operations in K by a randomized 
Monte Carlo (non- certified) algorithm. 

Proof. The matrix M can be evaluated at a random value xq in K in 0(mnd) operations. 
With high probability the rank is preserved. Then the rank ro < r after evaluation can 
be computed over K in 0{nmr u ^ 2 ) operations (see |22j and |3U1 Chapter 3]). We compute 
M = MR for R a random n x ro matrix over K in 0(nmMM(r,d)/r 2 ). □ 

Lemma 17.31 reduces the problem to the full column-rank case. We then apply the results 
of previous sections for computing m — ro candidate independent vectors in the nullspace of 
M. We finally test by multiplication whether the m — ro vectors are actually in the nullspace 
of M. A positive answer implies that r < ro, therefore certifies that r = ro, and that a correct 
nullspace representation has been constructed. 

The case m < 2ro has been treated in Section 17.11 It remains to handle in particular 
the situation m 3> ro. The sum of the Kronecker indices is at most rod, hence at most ro 
vectors may have degrees greater than d. For m > 2ro, we apply the technique of successive 
row indices selection of Section \7. II for computing m — 2ro independent vectors of degrees less 
than d, and will terminate by computing ro vectors of possibly higher degrees using the case 
m = 2rQ. 

Algorithm Nullspace(M) 

Input: M G K[x] mxn of degree d. 
Output: r = rankM, 

m — r "small" linearly polynomial vectors in the nullspace of M. 

(a) compute ro and M = MR G K[x] mxr ° using Lemma 17.31 
if m = ro then return m and {}; 

q ■= \(m - 2r )/r ]; 

(b) randomly ensure that the top ro X ro submatrix of M is non-singular or fail; 

(c) {N t ,l < i < m-2r } := Nullspace minimal vectors ( M W, d), 1 < k < q; 

(d) {JV/,1 < i < min{m,2r } - r } := Nullspace 2 n(M (9+1) ); 

in K[x]^ m_ro ^ xm the matrix whose rows are the N^s and the N^s; 

(e) if NM ^ then fail; 

else return ro and Ni, 1 < i < m — ro. □ 

For the first m — 2ro vectors of degrees less than d we work in q = \{m — 2ro)/ro] stages, 
and successively consider submatrices M^ l \ . . . ,M^ e K[x] txr ° of M, with 2ro < i < 3ro. 
More precisely, M^ G K[rr] 3roXr ° for 1 < k < q - 1, and G K[x]( m ~( < ?~ 1 ) ro ) xr °. Like in 
Algorithm Nullspace2 n we always ensure by randomization that the top ro x ro submatrix is 
non-singular. Each of the M^'s has at least i — 2ro nullspace vectors of degree at most d. 
Therefore, in at most q calls to Algorithm Nullspace minimal vectors (see also Remark 16.6(1 on 
the MW's with 5 = d we compute (q — l)ro + (m — (q — l)ro — 2ro) = m — 2ro nullspace 
vectors of degrees less than d. This is exactly in q calls if exactly t — 2ro nullspace vectors 
have degree less than d at each call, or if exactly i — 2ro vectors are kept. Otherwise, a 
greedy strategy as in previous section may need less calls. Without giving the details here, 



20 



we remark that ad hoc successive index choices for constructing the submatrices M^'s will 
lead to m — 2r$ linearly independent vectors (see Proposition 17.11 and its proof). Once this 
is done, we are led to a remaining min{m,2ro} x rg matrix M( 9+1 ) whose nullspace can be 
computed by Algorithm Nullspace2 n - If m < 2ro then M( 9+1 ) is simply the input matrix M. 
Again, we ensure independency by ad hoc row index choices. 

We do not further detail the proof of the algorithm which relies on similar techniques than 
those used for the proof of Proposition 17.11 The m — r$ computed vectors at Step (c) and 
Step (d) are in the nullspaces of full rank submatrices with ro columns of M, hence are in the 
nullspace of M . The check (e) ensures that they are in the nullspace of M. 

Theorem 7.4 Let M € K[rr] mxn be of degree d. The rank r of M and m — r linearly 
independent polynomial vectors in the nullspace of M can be computed in 

0(nmMM(r,d)/r 2 + (m/r + log r) (MM (r, d) log(rd) + r 2 B(c/) logr + rM(rd))) (22) 

hence O' '{nmr w ~' 1 d) operations in K by a randomized Las Vegas (certified) algorithm. The 
degree sum of the computed nullspace vectors is less than rd[~log 2 r] + (m — 2r)d. 

Proof. The cost for computing M using Lemma l7..3l is bounded by 0((imMM(r, d)/r 2 ). The 
top ro x ro matrix is made non-singular by pre-multiplication by a random constant matrix 
Q € K mxm (see Algorithm Nullspace2 n ) in 0(MM(n,d)). Since only the first ro rows of M 
need to be modified, the first ro rows of Q are randomly chosen in K, and the last m — ro are 
fixed to [0 I m _ ro ] T . The cost of the multiplication by Q is 0((m/r)(MM(r, <f))). At Step (c) 
we run Algorithm Nullspace minimal vectors q = 0(m/r) times on matrices of dimensions 
O(r). Each call has cost (j!8|) with n = r. Then at Step (d) one call to Algorithm Nullspace2 n 
has cost ()21|) with m and n in O(r). The two latter costs give the factor of 0(m/r + logr) 
in (|22|) . The final check at Step (e) is done in q + 1 multiplications using the special form of 
the intermediate results of Step (c) and Step (d). For one output of Nullspace minimal vectors 
at Step(c), the check is done in 0(n/r)MM(r,d) operations, therefore q calls lead to a check 
in 0((nm)MM(r, d)/r 2 ). As done in Corollary 16.51 for computing A, the check involving the 
output of Algorithm Nullspace2 n is done by splitting the large degrees in the iV 4 "s, and by 
forming an (min{m, 2ro} — ro) x m matrix of degree d, the multiplication by M is done in 
0((nra)MM(r,d)/r 2 ) operations. 

The degree bound follows from the fact that the minimal vectors computations of Step (c) 
lead to m — 2r vectors of degrees at most d. Proposition 17. II gives the term rd[log 2 r] for the 
degree sum bound for Step (d) outputs. □ 

For m < 2r we have already commented after Proposition 17.11 the quality of the degree 
sum bound rd[log 2 r] . For m~^> r, since the sum of the Kronecker indices is no more than rd, 
we see that the bound we propose in Theorem 17.41 is within a factor asymptotically m/r from 
the optimal. A more accurate "tri-parameter" analysis — with respect to n, m and r — remains 
to be done. It may first require slight modifications of the u-basis algorithm of [Tlll5| that we 
use for computing minimal vectors, and a corresponding cost analysis especially with respect 
to r when m ^> r. 

We conclude with a simplified expression of the cost for n = m and using r < n. 
The polynomial matrix multiplication has cost given by (j3J or ©, and we take M(e?) = 
0(cHog (flog log d) 0. 
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Corollary 7.5 The rank r of M € K[x] nxn of degree d, and m — r linearly independent 
polynomial vectors in the nullspace of M can be computed in 

0(MM(n, d)(log 2 ra + log n log d) + n 2 B(d) log 2 n log log n) 

hence O'fa^d) operations in K by a randomized Las Vegas (certified) algorithm. 

Remark 7.6 We did not detail the probability analysis. Random values in K occur for: the 
choice of P concerning the denominator matrix S and the right fraction degree bound in 
Proposition 14.21 the choice of Q in Lemma 15.11 for the degree dominance of the last columns 
in bases, and as linear independence conditioning in the different algorithms; the point xq in 
Algorithms Minimal nullspace vectors and Nullspace2 n ; the random conditioning of M into M 
in Lemma 17.31 Our algorithms are deterministic if random values are replaced by symbolic 
variables. For a given input matrix M, the algorithm succeeds if the random values do 
not form a zero of a fixed polynomial over K in the latter variables. This happens only 
with small probability if the random values are chosen from a subset of K of appropriate 
cardinality |12l 1351 129j (see also our comments in Introduction) . 

Concluding remarks 

We compute a K(x)-nullspace basis of an input matrix over K[x] as the union of few minimal 
K[x]-basis of submatrices of the input matrix. It remains to compute a minimal basis with an 
analogous complexity estimate. A possible direction of work here is to ensure the irreducibility 
of the output basis either on the fly or a posteriori. 

Subsequent work may also concern the applicability of our compression / uncompression 
scheme to other problems such as questions about matrix approximants or block structured 
matrices. 

Computing a nullspace basis is added to the recent list of problems that can be solved 
in about the same number of operations as for multiplying two matrix polynomials. We 
hope that this will help in making progress for the characteristic polynomial |181l21j . and for 
(non-generic) matrix inversion |16j . 
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